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Abstract 



We present some optimal criteria to evaluate model-robustness of non-regular 
two-level fractional factorial designs. Our method is based on minimizing the sum of 
squares of all the off-diagonal elements in the information matrix, and considering 
expectation under appropriate distribution functions for unknown contamination 
of the interaction effects. By considering uniform distributions on the symmetric 
support, our criteria can be expressed as linear combinations of B s (d) characteristic, 
which is used to characterize the generalized minimum aberration. We give some 
(~\| ' empirical studies for 12-run non-regular designs to evaluate our method. 

Keywordsnon-regular designs fractional factorial designs robustness affinely full- 
dimensional factorial designs D-optimality 



o\ : 1 Introduction 
O 

The most commonly used designs for two-level factorial experiments are regular fractional 
factorial designs. This is because properly chosen regular fractional factorial designs have 
many desirable properties such as being orthogonal and balanced. In addition, we can 
easily consider important concepts such as resolution and aberration for the regular frac- 
tional factorial designs in applications. For example, under the hierarchical assumption, 
i. e, lower-order effects are more important than higher-order effects and effects of the 
same order are equally important, a minimum aberration criterion by Fries and Hunter 
(1980) seems natural and widely used. As another reason for using regular designs, an 
elegant theory based on the linear algebra over F 2 is well established for regular two-level 
fractional factorial designs. See Mukerjee and Wu (2006) for example. The only draw- 
back of using regular fractional factorial designs is that its run size must be a power of 2. 
Therefore if the run size of the design is restricted not to be a power of 2 by some cost 
or manufacturing limitations, we must consider non-regular fractional factorial designs. 
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See Xu, Phoa and Wong (2009) for recent developments in non-regular fractional factorial 
designs. 

One approach of optimal selection for non-regular designs is various extension of the 
minimum aberration criterion to non-regular designs. For example, Deng and Tang (1999) 
proposed a generalized minimum aberration criterion, which is a natural extension of 
the minimum aberration criterion from regular to non-regular designs. Tang and Deng 
(1999) also proposed a minimum G2 aberration criterion, which is a simpler version of 
the generalized minimum aberration criterion. To justify these criteria, one approach is 
to evaluate these criteria from the viewpoint of model-robustness. For example, Cheng, 
Steinberg and Sun (1999) shows that the designs with the minimum aberration have a good 
property of model-robustness. Similarly, Cheng, Deng and Tang (2002) also investigate 
the generalized minimum aberration criterion from the viewpoint of model-robustness. In 
this paper, we follow these works and give a new criterion for model-robustness. Our new 
criterion is obtained as an extension of the approach by Cheng, Deng and Tang (2002). 
We consider contamination of two- and three-factor interaction effects for estimating the 
main effects, whereas Cheng, Deng and Tang (2002) only considers contamination of the 
two-factor interaction effects. 

Another approach of choosing non-regular fractional factorial designs is proposed re- 
cently by Aoki and Takemura (2009). Aoki and Takemura (2009) defines a new class of 
two-level non-regular fractional factorial designs, called an affinely full-dimensional facto- 
rial design. The design points in the design of this class are not contained in any affine 
hyperplane in the vector space over F2. Aoki and Takemura (2009) also investigates the 
property of this class from the viewpoint of D-optimality. However, the arguments of 
Aoki and Takemura (2009) is restricted to the models of the main effects, and the prop- 
erty of this class in the case of the presence of the interaction effects is not yet obtained. 
In this paper, we also investigate the relation between our new criteria and the affinely 
full-dimensional factorial designs. 

The construction of this paper is as follows. In Section [21 we give necessary defini- 
tions and notations for our criteria. We also review the generalized minimum aberration 
criterion and the affinely full- dimensional factorial designs briefly. In Section [21 we give 
definitions of our optimal criteria. One of the important contributions of this paper is to 
show the relation between our criteria and the generalized minimal aberration criterion. 
For this point, we give a general method to handle this problem and evaluate values for 
some cases. We also give empirical studies for 12-run non-regular designs. 

2 Preliminaries 

First we give necessary definitions and notations for our criteria. We use some of notations 
by Cheng, Deng and Tang (2002). We also review the generalized minimum aberration 
criterion and affinely full-dimensional factorial designs. 
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2.1 Definition of B s (d) characteristic 



Suppose there are m controllable factors with two levels. We represent an n-run design d 
hyX(d) e {-l,+l} nxm , an nxm matrix of -l's and +l's. The (i, j)th element of X(d), 
Xij(d), is the level of the jth factor in the ith run. Let S = {ji, ■ ■ ■ , j s } Q {!)••■ ? m }- 
Let Xs(d) be the component- wise product of the jith, . . ., j s th columns of X(d). The 
ith element of x s (d) can be written as J^Jxjj(d). Note that for any two subsets S, T C 

{1, . . . , m}, the component-wise product of Xs(d) and Xrid), say Xs(d) Qxrid), is written 
as x s (d) © x T (d) = x S AT(d), where SAT = (S U T) \ (S H T). We denote the cardinality 
of S C {1, . . . , m} by \S\. Then \S\ = s for S = . . . ,j s }. Define js(d) as the sum of 

n 

all the elements of x s (d), i.e., js(d) = Y\ x ij(d). For s — 1, . . . , m, we define 

i=l JGS 

S: |5|=s 

{B s (d), s — 1, . . . , m} is the key item in this paper. We call it -B s (d) characteristic. 



2.2 Generalized minimum aberration and affinely full-dimensional 
factorial designs 

Now we give the relation between B s (d) characteristic and the generalized minimum 
aberration criterion and affinely full-dimensional factorial designs. 

First we note that the set of js(d) values over all the possible S C {1, . . . , m} has all 
the information of the design d. In fact, Tang (2001) shows that a design d is uniquely 
determined by the set of js(d) values. Another basic fact is relation between js(d) values 
and the coefficients in the indicator function of d defined by Fontana, Pistone and Rogantin 
(2000). From the definition of the indicator function, js(d)/n = bs/b<p holds, where bs and 
b<j, are the coefficients of the term corresponding to S and the constant term, respectively, 
in the indicator function of d. See Fontana, Pistone and Rogantin (2000) for detail. 

On the other hand, B s {d) characteristic has the information of the aberration of 
designs. For example, if two levels are equireplicated for each factor of the design d, 
Bi(d) = holds. For the orthogonal designs, B 2 (d) = holds. If d is a regular design, 
B 3 (d) = holds for designs of the resolution IV, B 3 (d) = B±(d) = holds for designs of 
the resolution V, and so on. Considering these facts and the hierarchical assumption, Tang 
and Deng (1999) defined the generalized minimum aberration criterion as to sequentially 
minimize Bi(d), B 2 (d), . . . , B m (d). 

We also give the relation of the js(d) values and the affinely full-dimensional facto- 
rial design. Note that, for regular designs, each js(d)/n is +1,-1 or 0. By definition, 
\js(d)/n\ = 1 implies an aliasing relation, whereas \js(d)/n\ = implies an orthogonality. 
For non- regular designs, on the other hand, \js(d)/n\ can be strictly between and 1, 
leading to a partial aliasing relation. The affinely full-dimensional factorial design can 



3 



be characterized as the design satisfying < \js(d)/n\ < 1 for all S C {1, . . . , to}. See 
Lemma 2.2 of Aoki and Takemura (2009) for detail. 

From these considerations, the relation between the generalized minimum aberra- 
tion criterion and the affinely full-dimensionality is shown to some extent. Since B s (d) 
characteristic is the squared total of js{d)/n for all S satisfying \S\ = s, minimizing 
B s (d) coincides with minimizing each js{d) for \S\ = s to some extent. The difference 
is that the generalized minimum aberration criterion considers sequentially minimizing 
Bi(d), B2(d), . . . , B m (d), whereas the affinely full-dimensionality considers simultaneous 
control that each \js(d)/n\ is strictly less than 1. The aim of this paper is to investigate 
this relation from the viewpoint of the model-robustness. 

3 Optimal criteria for model-robustness 

To evaluate the model-robustness of the designs, one approach is to consider the estimation 
capacity defined by Cheng, Steinberg and Sun (1999). Though the original definition by 
Cheng, Steinberg and Sun (1999) is restricted to the regular designs, this concept is 
generalized by Cheng, Deng and Tang (2002) to non-regular designs. In this paper, we 
generalize their works and give general model-robustness criteria. 

When we choose fractional factorial designs, we can rely on various optimal criteria 
such as D-optimality based on the information matrix if the model to be considered is 
known. On the other hand, if the model is unknown, which is more realistic situation, 
we have to evaluate the model-robustness. In this paper, we consider the situation where 
(i) all the main effects are of primary interest and their estimates are required, (ii) the 
experimenters suppose that there are / active two-factor interaction effects and g active 
three-factor interaction effects, but which of two- and three-factor interactions are active 
is unknown and (iii) all the four-factor and higher-order interactions are negligible. This 
situation is a natural extension of the setting of Cheng, Deng and Tang (2002), where 



the case of g — for equireplicated designs. Another important case is / = 



meaning that (i) all the main and the two-factor interaction effects are of interest and 
their estimates are required, (ii) there are g active three-factor interactions, but which of 
the three-factor interactions are active is unknown and (iii) all the four-factor and higher- 
order interactions are negligible. The aim of our model-robustness criteria is to evaluate 
the influence of contamination of active interaction effects on the parameter estimation. 

3.1 Df g -criterion and Sj -criterion 



First we derive an information matrix in our settings. Let V be the set of all the 





subsets of the size two of {1, . . . , to}. Similarly, let Q be the set of all the 



( 



rn 



3 



) 



subsets 
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of the size three of {1, ... , m}. We have 



Q 



P = {{l,2},{l,3},...,{m-l,m}}, 
{{l,2,3},{l,2,4},...,{m-2,m-l,m}} 



and define 



W\ 



\Q\ 



G 



for later use. Let T C V and Q C Q be / active two-factor interactions and g active 
three-factor interactions, respectively. We write \T\ = f and \Q\ = g. Though we suppose 
that T and Q are unknown, it is natural to restrict the models to be considered to satisfy 
the following hierarchical assumption. 

Definition 3.1. T and Q are called hierarchically consistent if 



(ii,»2,*3) e G 



(zi,z 2 ), (ii,ia), «s) e F- 



For given JF and Q, we consider a linear model 

y = fil n + X{d)fo + !V(d)/32 + Z g (d)fo + e, 

where y is the n x 1 vector of observations, /i is an unknown parameter of the general mean, 
X(d) is the nxm matrix defined in Section |2~T| (3i is the m x 1 vector of the main effects, 
Yjr(d) is an n x / matrix consisting of the / columns x${d), S G JF, /3 2 is the / x 1 vector 
of the active two-factor interactions, Zg(d) is an n x g matrix consisting of the g columns 
Xs(d), S G Q, @3 is the gxl vector of the active three-factor interactions and e is an n x 1 

random vector satisfying E(e) = 0, var(e) = o 2 l n . Let Xjr g = [l n : X(d) : Yp(d) : Zg(d)]. 
Then the information matrix for the observations of d is written as 



Mr >g (d) = -X T> g{d)'Xr,g{d) 

1 ll' n YAd) \V n Zg{d) 

\x{d)'\ n \x{d)'x{d) \x{d)'Y T {d) \x{dyzg{d) 

±Y T (d)>l n \Yr{d)'X{d) l -Y T {d)'Y T {d) \Y T {d)'Z Q {d) 

\Zg{d)'\ n l -Zg{d)'X{d) lZg(d)>Y T {d) \Zg{d) 'Zg(d) 



If {JF, ^} is known, we can rely on various optimal criteria based on M^g(d) to choose d. 
For example, D-optimal criterion is to choose the design that maximize detM^ g(d). For 
the case that {J 7 , Q} is unknown, it is natural to consider the average performance over 
all possible combinations of / two-factor interaction effects and g three-factor interaction 
effects. To clarify the arguments, we consider probability functions over the set of all the 
subsets of, V, Q, i.e., 2 V , 2 Q , and consider the expectation of det Mjr t g(d) with respect to 
this probability function. If we have no prior information, it is natural to consider the 
uniform distribution 



Const, if T and Q are hierarchically consistent 
0, otherwise. 
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Consequently, we can use the expectation Df t9 = E p [det M^ t g(d)] to evaluate the model- 
robustness. We call this a .D /^-optimal criterion. 

However, there is a problem that the calculation of det M^ t g{d) is difficult. For this 
problem, we follow the approach by Cheng, Deng and Tang (2002) and consider minimiz- 
ing E p [tr(Mjr g(d)) 2 } instead of maximizing E p [det Mjrg(d)]. Note that the calculation of 
tr(Mjr j g(<i)) 2 is considerably easier than that of det Mjrg(d). It is also known that min- 
imizing tr(Mjrg^d)) 2 is a good surrogate for maximizing det M^g(d). See Cheng (1996) 
for example. In addition, since all the diagonal elements of Mpg(d) are 1, minimizing 
E p \ti(Mjr g(d)) 2 ] is equivalent to minimizing the expectation of the sum of squares of all 
the off-diagonal elements of Mjr g[d). We write this value as 

S 2 f = E p [sum of squares of all the off-diagonal elements of Mjr t g{d)\ 

and define our criterion. 

Definition 3.2. S 2 - optimal criterion is to choose designs that minimize S 2 g . 



3.2 Calculation of S 2 f „ values 

To evaluate the S 2 g value, we have to calculate all the off-diagonal elements of Myr j g(d). 
We consider each block in the partitioned matrix ([T]) separately. First we see that the 

(m(d)) 2 = Bi{d) by defini _ 



sum of squares of all the elements of (l/n)V n X(d) is 



i=i 



ra- 



tion. Similarly, the sum of squares of all the off-diagonal elements of (l/n)X(d)'X(d) 
is 2 (js(d)) _ 2B 2 (d) by definition. Since the calculations of all the other blocks 



sev 



depend on the probability function p(J-, G), we have the following expression. 



C2 



2B x {d) + 2B 2 (d) + 2E P 

m 



+ 2E V 



{i}AS 



+2E P 



+E V 



i=i s&g 



+ 2E V 



seg 



S&TT&g 



(2) 



^££o*at 



(d)f 



S.TeS 



Now all we have to do is to evaluate the expectations of d2J) for specific values of /, 
g and p{T,G)- In this paper, we only consider the cases that p{T,G) is the uniform 
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distribution on the symmetric support for the factors {1, . . . , m}. For these cases, Sj 
is expressed as a linear combination of Bx(d), B 2 (d), . . . , B 6 (d). Note that B 6 (d) only 
arises in the last term of ([2]) as the contribution of (jsat(^)) 2 where S and T are disjoint. 
Though the uniform assumption on the symmetric support is natural, there are various 
important situations where the support of p(J-", Q) is asymmetric. For this point, we 
consider shortly in Section HI 

Unfortunately, it seems very difficult to derive Sj g values for general /, g values. One 
of the simpler problems, evaluation of S^ 1} is also difficult. In this paper, we obtain the 
results on some specific cases. 

3.2.1 Calculation of S 2 f 

First we consider the situation that all the three-factor interaction effects are negligible. 
This situation is considered in Cheng, Deng and Tang (2002) for equireplicated designs 
and therefore our result is an extension of their result. In this case, the relation (T2]) 
becomes 



Sj = 2B 1 (d)+2B 2 (d) + 2E p 



^J2Us(d)) 2 +2E P i£x;u»A5(d)) 



i=l SeF 



+E V 



(3) 



and we consider the uniform distribution on V, 



pen 



The result is summarized as follows. 



Theorem 3.1. S"j is written as Sj Q = '^^a s B s (d) , wh 



ere 



a i 



a 3 



2 1 



f(m 



a 2 



6/ , 6/ (f-1) 

— ana a 4 = — ; 

F F(F-l) 



1 H : r(m 

F F(F — 1) 



We give the proof in Appendix A. Note that the result except for a\ is also given in 
Cheng, Deng and Tang (2002). From Theorem 13.11 we see the following result. 

Proposition 3.1. The relation a\> a 2 > a%> holds for m > 3 for Theorem \3.1[ 

We give the proof in Appendix B. Proposition 13.11 implies a consistency of the Sj Q - 
criterion and the generalized minimum aberration criterion. We see the optimal designs 
for these two criteria can be reversed by empirical studies for 12-run designs of 5 factors 
in Section I3T31 
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3.2.2 Calculation of S 2 Fg 

Next we consider the situation that all the two-factor interactions are active, i.e., the case 
of / = F. In this case, since T = V, we consider the uniform distribution on Q as 

P(Q) = ^r- 

The result is summarized as follows. 

6 

Theorem 3.2. Sp g is written as S Fg = ^^a s B s (d) , when 

s=l 

g(m — l)(m — 2 



a l = 2m + 

2g(m-2) g(g - l)(m - 2)(m - 3) 
fl2 = 2m + ^^ + G(G = 1) * 

a 3 = 6 + | + fc^, 

_ 8o 6ff(ff-l)(m-4) 
° 4 G" G(G-l) ' 

05 = ana 

_ 20^(^7 ~ 1) 

06 G(G-l)' 



We give the proof in Appendix C. From Theorem 13.21 we have the following result. 
Proposition 3.2. The relation ai > a 2 > 03 > CI4 > 05 > a e holds for m > 5 for Theorem 

We give the proof in Appendix D. Proposition 13.21 implies a consistency of the S F - 
criterion and the generalized minimum aberration criterion. 

3.2.3 Calculation of S$ A 

Next we calculate Sf 1; which means the situation that there are one active three-factor 
interaction and three active two-factor interactions included in the three-factor interaction 
hierarchically. In this case, the joint probability function and its marginal probability 
functions are written as 

,j~ g-^ _ f — , if T and Q are hierarchically consistent, 
[ 0, otherwise, 

p{0) = ^ 
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and 



j ^ i — , if there exists Q such that T and are hierarchically consistent 
0, otherwise. 

The result is summarized as follows. 

4 

Theorem 3.3. S\ x is written as Sfj = '^^a s B s (d) , where 

s=l 

( 9\ 
a t = 2 1 + - , 
V my 

f, , A{m -2) 
o 2 = 2 (to - 1) + 



G 

2(3m-5) 
a 3 = — and 

8 G 

We give the proof in Appendix E. From Theorem 13.31 we have the following result. 

Proposition 3.3. The relation a<i > a\ > a% > holds for m > 3 for Theorem \3.3[ 

We give the proof in Appendix F. Proposition 13.31 shows quite different tendency 
against Proposition 13.11 and Proposition 13.21 i.e., a\ < a 2 holds. This fact implies an 
essential difference between the Sf j-criterion and the generalized minimum aberration 
criterion, i.e., the 5| ^criterion puts more importance on the orthogonality between the 
columns of X(d) than the equireplicateness of two levels, which is mostly emphasized in 
the generalized minimum aberration criterion. Consequently, we can suppose the optimal 
designs for two criteria can be reversed. We investigate this point by empirical studies for 
12-run designs of 5 factors in Section [3731 



3.3 Sj - optimal designs for 12-run designs 

To clarify the relation between the Sj ^-criterion and the generalized minimum aberration, 
we consider fractional factorial 12-run designs of 5 factors. We are also interested in the 
affinely full-dimensionality of the optimal designs. Note that all the fractional factorial 
designs with n > 2 m ~ 1 are affinely full- dimensional since these designs cannot be a proper 
subset of any regular fractional factorial designs. See Aoki and Takemura (2009) for 
detail. Another reason that we consider 12-run designs is related to the existence of 
Hadamard matrix of order 12. Since the run size n = 12 is even, it is clear that the 
generalized minimum aberration criterion prefers the designs with equireplicated levels. 
It is also clear that we can easily construct orthogonal designs by choosing the columns of 
Hadamard matrices of order 12. See Deng, Li and Tang (2000) for example. From these 
considerations, we see that the optimal designs with the generalized minimum aberration 
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satisfy B\(d) = ^(c?) = 0. In fact, all the 12 x 5 designs constructed from five columns 
(except for 1 12 ) of Hadamard matrices of order 12, say d^, satisfy 

£i(4) = B 2 (d h ) = 0, B z {d h ) = 1.1111, B,(d h ) = 0.5556. 

We compare the B s (d) characteristics of the Sj ^-optimal designs with this value. 

We enumerate all the fractional factorial designs of 5 factors with 12 runs and obtain 
Sf o _ optimal designs for / = 1, . . . , 5 and S'| 1 -optimal design. We have confirmed that all 
the optimal designs are equivalent to the design shown in Tabled] by permuting factors or 
levels and changing signs. This design satisfies the Sj -, f = 1, . . . , 5 and Sf^-optimality 

Table 1: Sf Q - and S'| 1 -optimal 12-run design of 5 factors 



1 


1 


1 


1 


1 


1 


1 


-1 


-1 


-1 


1 


-1 


1 


1 


-1 


1 


-1 


1 


-1 


1 


1 


-1 


-1 


1 


1 


-1 


1 


1 


1 


-1 


-1 


1 


1 


-1 


1 


-1 


1 


-1 


1 


1 


-1 


-1 


1 


1 


1 


-1 


-1 


1 


-1 


-1 


-1 


-1 


-1 


1 


-1 


-1 


-1 


-1 


-1 


1 



simultaneously. The B s (d) characteristics for this design, say d s , are 

Bx{d s ) = 0.138889, B 2 (d s ) = 0, B 3 (d s ) = 0.27778, B A (d s ) = 0.5556. 

Since Bi(d s ) > B\(dh), d s does not have the generalized minimum aberration. We also 
see that d s is an orthogonal design and B±(d s ) = B±(dh). The difference between the 
two designs in view of B s (d) characteristics lies in B\(d) and B^{d). We see that the 
generalized minimum aberration criterion puts the importance on Bi(d), whereas the 
Sj^-criteria consider the overall values. Table [2] shows the Sj ,f = 1,...,5 and S 31 
values for dh and d s . 

Table 2: Sf Q , f = 1, . . . , 5 and x values for two deigns, dh and d s 





0-2 
°1,0 


°2,0 


C-2 
°3,0 


C-2 
°4,0 


r-2 
°5,0 


C-2 


d s 


0.5556 


0.9074 


1.3333 


1.8333 


2.4074 


1.7778 


d h 


0.6667 


1.4074 


2.2222 


3.1111 


4.0741 


2.6667 
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We see that both dh and d s are affinely full-dimensional, and therefore not proper sub- 
sets of any regular fractional factorial designs. This fact implies that the simple strategies 
such as choosing 12 rows from regular 2 5_1 fractional factorial designs to construct a 12- 
run design can cause a design of bad performance, in view of the generalized minimum 
aberration and model-robustness. 



4 Discussion 

We propose a general method to evaluate model-robustness for non-regular two-level de- 
signs. Though we suppose, in this paper, the four- and higher-factor interactions are 
negligible, which is considered to be a natural assumption in actual situations, we can 
easily generalize our method to incorporate higher-factor interactions. 

It is also possible to calculate S| values for small f,g such as Sf i or Sf 2 . 
Though the calculations will be rather complicated, they are indeed based on a simple 
counting. It is true that the assumption that the experimenters only have an information 
on the number of the interactions in the true model seems unnatural in actual situations. 
However, we think that the Sj values for small /, g can be used to evaluate the model- 
robustness. Here we regard / and g as the degree of contamination of interactions. 

Though we only consider the cases that p{F, Q) is the uniform distribution on the 
symmetric support for the factors {1, . . . , m}, there are various important situations where 
the support of p(F, Q) is asymmetric. One of the examples for asymmetric cases is that 
(i) there are m\ controllable factors and m — mi noise factors, (ii) all the main effects 
and two-factor interaction effects between the controllable factor and the noise factor are 
of primary interest and their estimates are required, (iii) all the two-factor interactions 
between two controllable factors are negligible, all the three- and higher-factor interactions 
are also negligible, and (iv) among the two-factor interactions between two noise factors, 
there are / — mi(m — mi) active interactions. For this situation, it is the important 
problem to investigate the model-robustness of designs for the contamination of the two- 
factor interactions between two noise factors. However, for such asymmetric situation, Sj 
values cannot be expressed as a linear combination of B s (d) characteristic. We postpone 
this attractive topic to future works. 



Appendix A. Proof of Theorem 13.1 

We evaluate the terms of ([3]) separately. First we have 



rv 



f 



EE 



Js(d) 



n 



n 



f 



B 2 {d). 
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Next from 



for S G J 7 , we have 



{i}AS 



S\i, if i G 5, 
{ijS 1 }, otherwise 



-En 



i E Efe-M) 2 l = -4yEEE (^) 



jc-cP i=i Se^ 



F 



EE 

1=1 5GP 



(4) 



3{i}As(d)' 



n 



f 

— I (m 

F 



DE 



j{i}(d) 



n 



^E 



js(d) 



n 



^((m-l)Si(d) + 3S 3 (tO)- 



i=l v 7 5eQ 

Similarly, for distinct z, j, fc, I G {1, . . . , m} we have 



SAT 



{i,j}, for 5 = {i,k},T = {j,k}, 
{i,j,k,£}, forS = {i,j},T = {k,£}. 



Then it follows 



S,T£T 
/(/-I) 



F(F-l) 2-^2-^ 



n 



{2{m-2)B 2 (d) + QB A {d)) 



F(F-l) 

by simple counting. From the above calculations, we have the theorem. 



Appendix B. Proof of Proposition 13.1 

For m > 3, we have 

a ,-^ = 2/(m -7- 2)(f .- /) >o 



and 

From the relations 
a 2 - a 3 

and 



03 — (14 



F(F-l) 

Qf(F-f) 
F(F-l) 



> 0. 



F(F-l) 



{(m - 2)/ 2 - (2F + m - 4)/ + F(F - 1)} 



(5) 



Q.E.D. 



(2F + m - 4) 2 - AF(F - l)(m - 2) = -(m - 2) 2 (m 3 - m 2 - 5m - 4) < 0, 
we have 02 > 03 for all /. Therefore we have shown the proposition. Q.E.D. 
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Appendix C. Proof of Theorem 13.2 

From JF = V and simple counting, we have 



2E n 



n- 



J2(3s(d)) 2 = 2B 2 (d), 



2E n 



t=l SeF 



^ E J2^s(d)) 2 = 2((m - 1)2?! + 3B 3 (d)) 



i=l SEP 



and 



^EE(w<^ 



S,T£.F 



S,TSV 



Therefore (T5]) becomes 

2mB 1 (d) + 2mB 2 (d) + 6B 3 (d) + QB 4 (d) + 2E P 



o2 



^E(^))' 



See 



+2£ D 



»=l See 

iEE(w(rf)) 



+ 2E V 



^EE(W^)) 5 



Se.FTee 



5,Tes 
S^T 



Now we consider the expectations above separately. From simple counting, we have 



E n 



see J ses v 7 



i=i see 
from (HI) for S G Q, 



1. 
G 



EE 

i=l SeQ 



j{»}As(rf)\ 2 9 



n 



G 



((m-2)B 2 (d)+4B 4 (d)) 



E n 



1 



n- 



Se^Tee 
g / (m — l)(m — 2) 

G 



9_\^\^ ( jsAr(d) 
G^^\ n 



B^d) + 3(m - 3)£ 3 (d) + 10B 5 (d) 



from 



{h}, for S = {i 2 , i 3 }, T = {i u i 2 , 13} 

SAT={ {h,i 2 ,i 3 }, for S = {i 3 , z 4 }, T = i 2 , u} 

{«i, £2, £3, £4, £5}, for S = {i 4 , 25}, T = {ii,i 2 , 23} 
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for distinct i\, . . . ,i§ G {1, . . . , m} and 



from 



G(G 



' S.TGC 



JSAT(d) 



n 



G(G - 1) 



((m - 2)(m - 3)B 2 (d) + 6(m - 4)B 4 (d) + 20B 6 (d)) 



{h, ^2}, for 5 = {h,i 3 , h}, T = «3, ^4} 

SAT = ( {ii,i 2) «3,«4}, for S = {ii,i 2 ,i 5 }, T = {i 3 ,u,i 5 } 

{ii,i2,h,k,i5,i6}, for £ = {h, i 2 , 13}, T = {i 4 ,i 5 ,i 6 } 

for distinct i\, . . . ,i§ G {1, . . . ,m}. From the above calculations, we have the theorem. 

Q.E.D. 



Appendix D. Proof of Proposition 13.2 

For m > 5, we have 

g(m-2)(m-3)(G-g) ^ 

ai ~ a2 = gWT) >0 ' 

_ 6g(m - A)(G - g) 
a *- a '- GjG^T) >0 

and 

20g(G-g) 
Q5 " a6= G(G-l) >a 
For the relation between a 2 and a 3 , we have 

a 2 -a 3 = ——- {(m - 2)g 2 - (AG + m - 6)g + 2G(G - 1)} 

and 

(4G + m - 6) 2 - 8G(G - l)(m - 2) 
= -8(m-4)G 2 + 16(m-4)G + (m-6) 2 

< -(m-4)(8G(G-2) - (m-4)) 

. / m 2 (m — 4) . „ 

< -(m-4) 8 — i J -(G - 2) - (m - 4) 

\ 6 



\2 



(m-4) ( 
3 



(4m 2 (G-2)-3)) 



( m -4) 2 
< -- — — — (4-5 2 -8-3)) < 

since G > m 2 (m — 4)/6 holds for m > 5 and m 2 (G — 2) is a monotone increasing function 
of m. Similarly, for the relation between and 05, we have 

« 4 - a 5 = —l—- {( m - % 2 - (2G + m - % + G(G - 1)} 
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and 



(2G + m - 6) 2 - 4G(G - l)(m - 4) 
= -4(m - 5)G 2 + 8(m - 5)G + (m - 6) 2 
< -(m-5)(4G(G-2) - (m-5)) 
m 2 (m — 5) 



6 



-(G - 2) - (m - 5) 



< -(m - 5) I 4 

= -^ y ^(2m 2 (G-2)-3) 

< - (m ~ 5)2 (2-5 2 -8-3)<0 

since G > m 2 (m — 5)/6 holds for m > 5 and m 2 (G — 2) is a monotone increasing function 
of m. Therefore we have shown the proposition. Q.E.D. 



Appendix E. Proof of Theorem 13.3 



In this case, we write Q = {U} G Q and Zg(d) = Xjj(d). Then ([2]) becomes 



S 2 A = 2B 1 (d) + 2B 2 (d) + 2E p 

— 2 E0'5AL/(d)) 



+ 2£ D 



+ 2£ p 


[Cf) 2 " 


+ 2£ p 









^EE^WAsW) 

j m 
-^E^WAf/W) 



i=i sg^ 7 



i=l 



+2E P 



We consider all the terms of ([H]) separately. From simple counting, we have 



2E„ 



S<=F 



2 m-2^ 



G — \ n 

Sep 



38(d) 



2(m-2) 
G 



S 2 (d), 



2£„ 



j m 

^EE&w<o) s 



i=l Se^ 7 

2(m - l)(m - 2) 



Jw(rf) V + (3 + 3(m-3))$:^ ) 



5GQ 



G 



G 



from (H for 5 G J* 7 , 



-En 



^EE^(«o) s 



s,tg.f 



2(m-2)J2 



sev 



3s(d) 



n 



2{m-2)B 2 {d) 



(6) 
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from (jSJ) where S fl T 7^ 0, 



2£„ 



G ^ 



t/eS 



3u{d) 



n 



2E„ 



n- 



^2(j{i}Au(d)f 



i=l 



G 



m 



2 >E 



Js(d) 



n 



+ 4 E 

S;\S\=4 



Js(d) 



n 



from (gl) for S = U G Q and 



2EL 



2_3G 
G m 



E 



-Si(d) 



from S G U and SAU = U\S. From the above calculations, we have the theorem. Q.E.D. 



Appendix F. Proof of Proposition 13.3 



For m > 3, we have 



a 2 — cti 



ai - a 3 



mG 
m — 2 

3G 
2 



((m 2 - 2m - 9)G + 4m(m - 2)) 



G 



3G 



(m 3 - 3m 2 - 7m + 33) > 0, 

((m + 9)G-m(3m-5)) 
[m 3 + Qm 2 - 28m + 23) > 



and 



a 3 - a 4 = —(3m - 9) > 0. 
G 



Therefore we have shown the proposition. 



Q.E.D. 
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